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CLOSED LOOP THREE COLOR ALIGNMENT FOR DIGITAL 

PROJECTION 
CROSS REFERENCE TO RELATED APPLICATIONS 

Reference is made to commonly-assigned copending U.S. Patent 

5 Application Serial No. (Attorney Docket No. 83620), filed herewith, 

entitled A CLOSED LOOP THREE COLOR ALIGNMENT SYSTEM FOR A 
DIGITAL PROJECTOR, by Nelson et al., the disclosure of which is incorporated 
herein. 

H FIELD OF THE INVENTION 

10 This invention relates in general to a digital projection system and 

in particular to a closed loop three color alignment system for digital projectors. 
3 BACKGROUND OF THE INVENTION 

%l In a digital projection system involving the use or three separate 

^ light-modulating devices such as LCDs or micro-mirrors, image convergence 

1 5 depends upon the accurate registration of the three separate images created by the 
light modulating elements. For sin^Ucity sake, we will look at this invention with 
regard to, but not limited in scope to implementation with an LCD device. With 
poor image convergence, the contrast and sharpness of 1he image both suffer, and 
in addition fringing of the image may occur. For example, a white dress may 
20 have a green fringe on one side and a red fringe on the other when shown against 
a dark background. These degradations are obviously undesirable in a projection 
system. Adding to the chance of poor convergence is the likelihood of higher and 
higher resolutions for a variety of applications including digital cinema. With 
these higher resolutions comes increasing difficulty in achieving and maintaining 
25 convergence (usually a fraction of a pixel) due to the smaller pixels on the 

devices. In a device with large temperature changes such as a projector, even with 
attention to the thermal expansion of the LCD fixturing and other optical 
components, positional fixturing without complex designs or extravagant 
materials has a finite practical limit that is currently the same order of magnitude 
30 as the pixel size. 

A current method of performing a six-degree of freedom alignment 
(x, y, z, and rotations around x, y, and z) is to use a fixture to align Uie image 
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modulating devices and hold them in place while they are fixed using solder or 
adhesive to a set of pads built into the optical system. The image modulating 
devices can then be removed from the fixture and re-used. This type of alignment 
can take a long time especially if the fixture adjustments are not entirely 
5 orthogonal and independent. (Rotation adjustments are seldom possible around 
the exact center of an image modulating device.) For example, in rotating the 
image modulating device around the z-axis to eliminate a skew error, one could 
potentially also be altering its position in x and y . This method requires high 
precision fixturing, and possibly many iterations to achieve the required 
5 ^ 10 alignment. Even if the proper alignment is achieved with the fixture, errors in the 
O final position of tilie image modulating devices can resxilt. For example, tilough 

y this method is performed with the image modulating devices and projector 

running, due to the need for access to the device, the system may not have all of 
y| it's covers and cooling operational. Therefore, as the alignment is not performed 

1 5 at the projector's working temperature, this can lead to positional errors, and a 
H resulting lack of color convergence when the projector is run completely 

Q assembled at a different operating temperature. Convergence using this method 

l| - e 

,S can also suffer from positional inaccxiracies resxilting from induced stresses in the 

m joints caused by the solder cooling or the adhesive shrinking. This is a one-time 

20 adjustment and does not allow for realignment at a later date. 

An alternate method is to provide manual adjustments on some or 
all of the axes in the projector to enable in-projector alignment. This method is 
potentially expensive as the precision adjustment remains with the projector, 
potentially cumbersome in terms of getting adjustments for all of Hie stages to fit, 
25 and difficult to design athermally. For some applications, it may also be possible 
to rely on simply butting the image modulating devices to datum structures within 
the projector. Even with precisely ground components and tight manufacturing 
tolerances, this method is seldom accurate enough for high-resolution systems. 

Macauley et al. discloses an image registration system in U.S. 
30 Patent No. 4,683,467 which registers multiple images on a screen. This system 
makes use of sensors mounted to the screen as input for the correction system. 
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Because the detection takes place at the screen, photodetectors are required to be 
located on or near the screen detracting from the viewing experience. 

Ledebuhr in U.S. Patent No. 5,170,250 shows an internal image 
registration system which is suitable for use in a projector. The light valves 
5 produce alignment beams which are sensed internal to the projector by 

photodetectors to control the CRT light valves. A disadvantage of this invention 
is that a spatial relationship needs to be maintained between the three 
photodetectors. Such a system is not capable of correcting for eitiier skew or 
focus. In addition, the correction methods used will not work for image 

1 0 modulating devices such as LCDs and micro-mirrors which cannot be aligned 
electronically to high resolution. 

Hara et al. in U.S. Patent No. 5,592,239 disclose a projector device 
with the capability to properly register the image in translation and rotation. 
However, the device is only able to be used during an off-line alignment of the 

1 5 projector because the detection system is not sxuted to closed loop operation whilst 
projecting images. 

There is a need for a metliod and apparatus for creatiag and 
maintaining proper pixel alignment without requiring high-precision fixtures and 
projector components. Also there is a need for a method and apparatus for 

20 performing a continuous image registration in a projection system. 

SUMMARY OF THE INVENTION 
The problems discussed above can be overcome and better 
performance achieved with a closed loop system for aligning and maintaining the 
alignment of these devices. Briefly, according to one aspect of the present 

25 invention a digital projector that has closed loop three color alignment comprises a 
light source where an optical engine splits a beam of light from the light source 
into first, second, and third wavelength bands. A first, second, and third spatial 
light modulator imparts image data and first, second, and third fiducial data 
respectively to the first, second, and third wavelength bands. The first, second, 

30 and third wavelength bands are directed to the first, second, and third spatial Hght 
modulator, respectively. A combiner combines the modulated first, second, and 
third wavelength bands. A diverter diverts a portion of the combined modulated 
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wavelength bands to at least one sensor. The sensor then senses a relative position 
of the fiducials and sends the position information to a microprocessor. The 
microprocessor then determines an error based on tiie relative position of the 
fiducials. The microprocessor sends a signal to at least one component of the 
5 system to resolve the error. 

Consistently better image quality can be achieved by eliminating 
thermal errors in the mounting of image modulating devices in real time providing 
perfect registration over a wide temperature range. An additional benefit is that 
s J. the initial alignment to mount flie image modulating devices need only be as good 

P 10 as a few pixels simplify the fixuring and procedures required. The design of the 

'Saw 

y projector can also be made simpler by not requiring as good thermal stability of 

the image modulating devices and associated optics mounting. 
Ul The border pixels of the three separate image modulating devices 

J, to provide a fiducial pattern that can be used for alignment, for example multiple 

1 5 pixels in each comer of the device. Upon recombination of the light from each of 
3 the three devices, the single light path is split into two components. The majority 

3 of light will be the normally projected image area, while the remainder of light, 

containing the fiducial information in the border areas is cropped. This small 
amount of light (also containing the fiducial surround) is directed to a sensor, 
20 which will be used to determine the pixel locations of the fiducial pattem and in 
turn, determine the required positional. Determination of which device requires 
positional adjustment can be done utilizing many means, including, but not 
limited to a selective application of filters to separate the colons, or by illuminating 
■tfie fiducial patters on the three image modulating devices in a predetermined 
25 sequence. If a correction is required, actuators on the red and blue image 

modulating device mounts are powered to bring them back into aligimient with the 
green reference channel. 

In one embodiment of this idea, if alignment to within a half pixel 
is adequate, it would be possible eliminate the actuators and make all of the 
30 correction electronically, shifting where the row and column data begins and ends 
separately for the three channels. The simplest useful correction would be a 
simple X and y translation which would require only one fiducial point. A more 



useful correction accounting for possible skew requires at least two fiducial 
points. Embodiments performing these types of correction can be implemented 
moving optical components such as mirrors, prisms or simply the image 
modulating devices. 
5 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 shows an image modulating device with border pixels 
being used in the method. 

Figure 2 shows the complete optical system of a preferred 

embodiment. 

10 Figure 3 shows a variation of the preferred embodiment in the 

fiducial monitoring portion. 

Figure 4 shows another variation of the preferred embodiment in 
the fiducial monitoring portion. 

Figure 5 shows another variation of the preferred embodiment in 
15 tiie fiducial monitoring portion. 

Figure 6 shows a variation of the preferred embodiment with focus 
sensing optics and fiducials. 

Figure 7 shows focus sensing fiducials, sensors, spot shape upon 
defocus, and a sample focus error signal. 
20 Figure 8a shows an optical correction device which allows for a 

translation of the image. 

Figure 8b shows an optical correction device which allows for a 
rotation of the image. 

Figure 8c shows an optical correction device which allows for a 
25 rotation of the image. 

DETAILED DESCRIPTION OF THE INVENTION 
Turning now to Figure 1, an image modulating device assembly is 
shown. It consists of an image modulating device mounting plate 100 to which an 
image modulating device 101 is bonded. This mounting plate is used to fix the 
30 image modulating device into the optical system. The attachment of the image 
modulating device to the optical system can be done by soldering or bonding it to 
a mating surface in the optical system. Contained within the image modulating 
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device is an active pixel area 102 containing active pixels which can be imaged- 
wise turned on and off. This active pixel area is further broken down into a 
central pixel area 103 to be used for tlie projected image, and a surrounding area 
to be used for fiducials 104. This surrounding area of the three separate image 
5 modulating devices can be used to provide a fiducial pattem that can be used for 
alignment, for example a spot in each comer. The size of the surrounding area is 
not important to the invention, but is preferably small such that a majority of the 
active pixels can be used for the image. It is also preferred to leave a buffer 
section of unused pixels between the active area used for imaging 103 and the 

] 0 active area used for fiducials 104. This is desirable such that the fiducial detection 
devices which will be discussed do not themselves have to be aligned accurately 
to the image. To facilitate detection by the sensor 21 of Figure 2, it is also 
possible that the fiducials 1 10a and 1 10b comprise more than one pixel. The 
fiducial can be can be made up of a combination of on pixels surrounded by off 

1 5 pixels, or off pixels surrounded by on pixels. Similarly, they may be defined in 
particular patterns, such as cross shapes or other patterns which may enable 
recognition of a deviation fi-om tiie proper co-aligned state. An example of such a 
pattem is shown in the detail enlargement of fiducial 1 10a. 

The following discussion applies to Figures 2-5. All of these 

20 figures show illumination optics 30, an optical engine 50, and a fiducial 
monitoring and projection section 70. There are many configurations of 
illumination optics 30, optical engines 50 commonly practiced, and the specifics 
of the illumination optics 30, and the optical engine are not critical to the 
invention, but are included for completeness. 

25 A lamphouse 1 provides illumination for the projector. A cold 

mirror 3, separates the visible light from the infrared to limit the amount of heat 
introduced to the remainder of the optics. Input optic lenses 2 shape the beam for 
efficient coupling of the visible illumination into integrating bar 4 which is then 
used make the light, relayed to the image modulating devices 11, 12, and 16, by 

30 lens 5, more uniform. The white light is tiien split into three spectral bands, 
t3^ically red, green, and blue, using dichroic filters 6 and 8, each spectral band 
provided with a means of polarization separation, such as polarization 



beamsplitters 9, 10, and 15. Each spectral band is therefore polarized upon 
reflection prior to reaching image modulating devices 11, 12, and 16. Image 
modulating devices 11, 12, and 16 are mounted on actuation devices 13, 14, and 
17 respectively. These actuation devices are used to provide the regisfration 
alignment of the images from each of the three spectral bands. Image modulating 
devices 11, 12, and 16 containing arrayed pixels can rotate the incoming 
polarization on an individual basis, thereby causing the light reflected off these 
devices 11,12, and 16 to transmit through the dielectric polarizing coatings of 
beamsplitters 9, 10, and 15. 

Referring now specifically to Figure 2, in the fiducial monitoring 
and projection section 70, following the dichroic recombining element 18 of the 
optical engine 50, a partial mirror 19 is placed to sample the illumination. An 
example of such a device is a plate glass with a dielectric anti-reflection coating 
on the second surface. The first surface, being uncoated, will have reflection 
according to Fresnel reflection laws. Alternatively, tiiis first surface may be 
coated with a dielectric coating to provide for a tuned amount of reflection. The 
majority of the light continues through the partial mirror, the fiducials are 
removed by a mask 22 which occludes the area inside the active pixel area used 
for fiducials 104, and is projected to a viewing screen 24 as in any other projector 
using a projection lens 23. The fraction of light diverted by the partial mirror 19 
is then imaged by a lens 20 onto a sensor 2 1 , which is able to gather pixel 
locations of the fiducial marks. An example sensor may be a single CCD imager, 
or two smaller CCD imagers placed only to detail the image of the fiducials, a 
photodiode, or any other light-sensing device. These pixel locations are then sent 
to and operated on the microcontroller 25 which, using an algorithm to be 
described later determines based on the positions of the fiducial pattern on all 
three channels, if a correction is required. This determination results in control 
signals to one or more of the image modulating device actuators 13, 14, and 17. 
These actuators then in turn translate or rotate the image modulating devices 1 1 , 
12, and 16 such that thy are brought into correct alignment with each other. This 
sensor determines the pixel locations of the fiducial pattern on all three colors and 
determine if a correction is required. If a coirection is required, actuators 13,14, 



and 17 on the red and blue image modulating device mounts are powered to bring 
them back into alignment with the green reference channel. 

There are several methods which can be employed to present the 
fiducial information in 110a and b to the sensor 21. In a preferred embodiment, 
the image modulating devices 11,12 and 16 image the fiducial marks 110 
sequentially in a predetermined temporal sequence such that a monochrome 
sensor can be used. For example, if the predetermined order is green, red, blue, 
delay. The green image modulating device 16 displays it's fiducials while the red 
and blue image modulating devices are blank. The pixel locations on the 
monochrome sensor 21 are stored in memory, and then the red image modulating 
device 1 1 fiducial pattern 1 10 is activated, and the locations of the red fiducial 
pattern are stored. Finally, the same procedure is repeated with the blue device 12 
such that the monochrome sensor has now gathered the pixel locations of all three 
colors. These stored pixels locations are then analyzed by a microprocessor 25 to 
determine whether or not they are in acceptable convergence. The microprocessor 
is able to clock using the delay and then register the separate color signals in order 
to differentiate which fiducial signal corresponds to which image modulating 
device. 

A second embodiment introduces a series of colored filters 27 in 
front of a monochrome sensor. Firstly a green filter is placed in front of the 
sensor allowing the green fiducial information to be gathered. Continuing in a 
similar fashion, the fiducial data from each color can then be individually gathered 
by a monochrome sensor. This method enables each of the image modulating 
devices to display their fiducial information continuously. For convenience, the 
three color filters are likely placed on a rotating wheel, 

A third embodiment is to simply use a color sensor. In all of the 
embodiments, it is important that the sensor have adequate resolution to 
adequately capture the fiducial information. As corrections of fractions of a pixel 
are required to maintain a high quality image on the screen, it is required that each 
fiducial 1 10 be mapped onto multiple sensor pixels. 

It should be noted that although the invention is shown with the 
ability to translate and/or rotate all three light modulation devices, that this is not a 
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requirement of the invention. One of the image modulation devices may be 
permanently moimted in a fixed position and used as a reference for the other two 
colors. This is most likely the green channel 16 and 17, and in future will be 
discussed as the fixed channel. 
5 Many configurations are possible, however, the exact configuration 

is not critical to tiie invention. All optical engines that split the light so it is 
modulated by at least two separate light modulation devices will benefit fi^om the 
invention. 

Referring now to Figure 3, the input optics 30, and optical engine 

10 50 are identical to those of Figure 2 and will not be discussed in detail again. The 
partial mirror 19 of Figure 2 has been replaced by a periphery sensor 21a. A 
significant advantage is realized as this sensor replaces the partial mirror 19, the 
sensor 21 and the mask 22 of the previous method and serves all three functions. 
A lens 20 is required such that the periphery sensor is at a focused image plane. 

1 5 The sensor 2 1 a both gathers the fiducial data 1 1 0, and blocks it from being 

projected to the screen 24 by the projection lens 23. Because the sensor is being 
place in a large amount of illumination, it may be desirable to have a light 
reducing element integral to the sensor. In addition, because of the absorbed light 
energy, the mounting for a periphery sensor may require a heat sink (not shown). 

20 It may be impractical to insert a sequence of filters 27 into such a 

system as if they occluded any of the active pixel area designated for images 103, 
the image would be degraded. It is therefore preferred that in this embodiment, 
either a color sensor is used on the periphery, or the temporal discrimination 
method discussed earlier is used with a monochrome sensor. As before, the 

25 microprocessor 25 determines whether the fiducials, and therefore the images are 
in acceptable convergence. If not, appropriate corrections are made either 
electronically (adjusting the start and stop rows and columns for the channels) or 
mechanically (adjusting the physical locations of the sensors or rotating optical 
mirrors) such that the fiducials and therefore images again line up. Due to the 

30 tighter control of the manufacturing process for the sensors, it may be assumed 
that if the fiducials line up, then so do the images. 
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Tuming now to Figure 4, as before, the input optics 30, and optical 
engine 50 remain unchanged. Li this embodiment, rather than inserting a digital 
periphery sensor 21a into the path, a simpler periphery mirror 19a is inserted. 
This periphery mirror 19a, unlike the partial mirror 19, obscures all of the active 
pixel area used for fiducials, therefore eliminating the need for a separate mask. 
The fiducial information is then relayed to the sensor 21 by a lens 20, and the 
remainder of the process is as described earlier. As before due to the amount of 
illumination being diverted, it may be advantageous for the sensor to include a 
light reducing element. 

Another embodiment is shown in Figure 5. A mask 22, is inserted 
into the light path to block the fiducial information from being projected. As was 
the case in figure 3, a lens is required to provide a focused image at the imaging 
surface 26 of the mask 22. This imaging surface is preferably flat and able to 
provide good contrast when impinged upon by the fiducial information. An image 
sensor 21, such as a CCD camera, then captures the reflected light from the mask 
22 and supplies the fiducial information to the microprocessor 25 as before. A 
heat sink may be required due to the amount of illumination being absorbed, and 
the reflected light becomes stray light inside tiie projector and is preferably 
absorbed before it can be projected causing undesirable flare. 

The microprocessor 25 establishes a conti"ol loop. After collecting 
the positional information firom the sensor 21, an algorithm determines an 
appropriate corrective action. This control loop can be repeated immediately for a 
continuous closed loop correction. Depending on the algorithm used by the 
microprocessor, however, this might cause excessive corrections to be made. For 
example, if the algorithm has too small a "dead-band" or amount of acceptable 
error, it might be found that if the means of correction does not have adequate 
resolution, a correction is implemented each time the loop is run in the opposite 
direction. For this reason, and to save on processing/actuating power etc. a 
significant delay might be implemented between successive corrections. Given 
flie relatively slow time constant for the most likely thermal and other 
disturbances to the system, this should not be a problem. 
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Whereas the positions of the fiducial markings on the sensor could 
be used for the feedback to the actuator, it may be desirable to have a separate 
positional feedback at the image modulating device site. In such an embodiment, 
based on sensor input, the controller can send a discrete move distance and 
5 direction to the actuator that will then have the capability to reliably achieve the 
desired position without further feedback from the fiducial sensor. This 
decoupling of the feedback loops has certain advantages. Firstly, the actuator is 
not limited to the rather slow expected time constant of the vision system. For 
1^ example, piezoelectric motors working with integrated capacitive displacement 

^ 10 sensors can achieve response times in a few milliseconds which is considerable 

yj faster than the vision system can or is required to operate. Secondly, it is 

,^ desirable to be able to isolate problems in the system to either the vision system, 

W or the actuator, which would not be possible in a single feedback loop. Thirdly, 

= Uiere are off the shelf controller systems, which are designed to work with paired 

2 15 actuators and position systems. 

O It is recognized that the resulting error when looking at the sum of 

fi the differences of the distance between the reference channel and the other two 

- channels may not ever be able to reach zero. In an ideal world of course with the 

ability to correct for x, y, and skew errors, this should be possible. However, as 
20 lenses refract differing wavelengths of light to a different degree, tiiere may be 
magnification differences between the color channels as well as differences 
resulting firom manufacturing of the image modulating devices. Neither 
magnification nor lack of squareness of the fiducial pattem can be corrected using 
this method. It is therefore recommended that an error be allowed, and the 
25 algorithm programmed to minimize this error. 

The type of actuation required wiU produce very small 
displacements precisely (on the order of a few microns). The ideal actuator 
produces this amoimt of displacement in a small package. Preferred are 
piezoelectric actuators for their small package size, reliability, quick performance, 
30 commercial availabihty, and precision. When coupled with a flexure mounted 
stage setup, piezo actuators can provide a low fiiction / stiction movement with 
adequate precision and travel range. For example the P-500 series multi-axis 
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piezo flexure nano-positioners from Polytec PI Inc. in Auburn, MA would have 
tiie appropriate capabilities for this application including a version with all 6 
degrees of freedom and its own feedback. 

Piezo motors can be costly. This invention is not limited to the use 
5 of these motors. One skilled in the art could certainly envision many other 

alternatives such as stepper motors witii appropriately scaled down displacement 
ranges through levers and lead screw. 

Turning now to Figures 6 and 7. The main invention as described 
would not correct for focus, luckily there is usually less precision required in the 

10 plane of the optical path. If focus correction were critical to a design, all 6 

degrees of freedom could be detected. This system can be implemented to also 
correct for relative defocus of the image modulating devices. One method would 
be to over sample the fiducials with the CCD sensor. An algorithm could be 
created in order to minimize the number of pixels that the fiducials occupy on the 

15 CCD. This would be disadvantaged in that in order to determine the optimum 
position of focus, the image modulating device must be moved. An alternate 
approach would be to create a specific fiducial set for focus detection. One 
example would be to use a round spot fiducial, as shown in figures 6 1 a and 6 1 b on 
the image plane of fiducials 62a and 62b used for convergence correction. Optics 

20 can be implemented such that astigmatism and power is induced into the round 
spot of these fiducials. For example, placing a cylinder lens, spherical lens 
combination into the field that relates to the diagonal imaging the focus fiducials 
as in figure 28. Quad sensors, figures 67a and 67b, are placed in the image plane 
of these fiducials, with its cells at a 45 degree angle with respect to the cylinder 

25 lens creating the astigmatism. The position of the quad cell is such that best focus 
is at the "disk of least confusion" for the image of the fiducial. This intennediate 
image between the two line focus positions created by the cylindrical lenses is 
round as shown in figure 64. Upon defocus of the image modulating device in 
one direction, the "disk of least confusion" begins to form a line focus, as in figure 

30 63. This effectively removes light off of two of the cells, b and c of the quad 
detector, and places it on the altemate two cells, a and d. Similarly, if the image 
modulating device is defocused in the opposite direction, the opposite two cells 
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gain the additional light. In this fashion, by adding the light levels from the 
diagonal cells and subtracting this from the other diagonal cells and normalizing 
this by the sum of all cells, a directionally deterministic signal, as shown in figure 
66, is created which is independent of light level. Implementation of tMs type of 
5 system is well known in the art. Examples may be found in many camera systems 
and optical recording systems. Other similarly common means of focus detection 
may be used for this ^plication. 

Figure 8a shows an optically transparent plate 80 which can be 
used to ti^slate the image. The plate as illustrated has the capability to rotate 

1 0 between two angularly different positions 84 and 85 such that the light beam 8 1 is 
translated between corresponding positions 82 and 83. Two such plates or a 
single plate which has the ability to tip and tilt in two directions can be used to 
translate the image in both the x and y directions. The plate 80 can be inserted in 
the optical path in many locations, most preferably between the polarizer cube 9, 

15 10 and 1 5 and the combining x-cube 1 8. Alternatively, the plate 80 can be 
inserted between the polarizer cube 9, 10 and 15, and the image modulating 
device 1 1, 12, and 16. 

Figures 8b and 8c show two methods of optically rotating an 
image. Prism 90 when rotated causes twice the amount of rotation to occvir 

20 between the light beam 9 1 and the ou^ut light beam 92. Similarly a K mirror 94 
provides the same ability to rotate the light beam 93 and output light beam 95. 
The prism 90 and K mirror 94 can be placed in the optical system in the same 
positions previously discussed for the optically transparent plate 80. 

The invention as described supposes a 6 degree of freedom 

25 actuation possibility for at least two of the image modulating devices, however, 
there are many embodiments which can be implemented more simply. 

Firstly, if alignment to within a half a pixel were adequate, it would 
be possible to do away with the actuators entirely and make all of the corrections 
electronically, shifting where the row and column data begins and ends separately 

30 for the three channels. Electronic correction such as this is practiced commoiJ.y, 
and is described in U.S. Patent No. 5,729,245 by Gove et al. Obviously, in such a 
system, no capability exists for either skew correction or focus correction. 
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However, many less critical applications can tolerate as much as a half a pixel 
correction, and such a system is much simpler to implement with no moving parts 
in the image modulating device area. In all systems involving substantial 
correction which occurs all at one time, such as is the case when the spatial light 
5 modulator driver signals are indexed by a pixel, it is desirable to make these 
corrections at a time when it is least impactful on the viewing of the images. 
Ideally, large immediate corrections to the image alignment should be performed 
during scene changes or when the image field is substantially uniform. Other 
more subtle corrections performed mechanically or optically can be implemented 

1 0 continuously or discretely without regard to scene content without negatively 
impacting the viewing experience. 

A second embodiment which also is simpler to implement than a 
six degree of freedom correction is a mechanical correction of x and y only. In 
addition to simpler actuating mechanisms, a great advantage can be realized in 

1 5 such a system by recognizing that only one fiducial point per color channel is 
required. Only requiring a single point to be imaged on the sensor 2 1 allows for 
either greater resolution or a much smaller sensor. 

A third embodiment is to eliminate the three focus corrections, and 
simply correct for skew, and x and y translations. This level of correction requires 

20 at least two fiducial points, and three independent actuators. Such an embodiment 
eliminates three degrees of fi"eedom creating a simpler actuation mechanism, but 
maintains tiie ability to perform the most sensitive corrections for convergence. It 
is desirable in such a system to design a large depth of focus at the image 
modulation device. 

25 A fourth embodiment is to use the same fiducial gathering methods 

as discussed, but keep all of the image modulating elements fixed. The 
convergence and focus correction can then be achieved through the actuation of 
other optical elements in the optical engine. As shown, prisms or k-mirrors can be 
rotated rather than rotating the image modulating device, and planar transparent 

30 optical plate elements can be rotated in two directions providing an effective x and 
y translation. 
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A fifth embodiment would be to use all of the detection and 
correction means described above in an off-line calibration routine. The existing 
invention, as described, requires "wasting" of a few border rows and columns, 
which could be used for image data. In addition, for continuous correction, in 
many of the fiducial gathering embodiments, the invention requires that a small 
amount of light, which would add to the screen illumination, be diverted to a 
sensor. If these limitations are critical for a design, an oflF-line calibration routine 
could still be done while the projector is not showing image data using the same 
method. Any of the mechanical, optical, or electronic correction means could be 
used. 

A sixth embodiment combines the use of mechanical and electronic 
correction. The electronic correction can be used as a means of coarsely aligning 
the image modulating device in x and y, thus permitting the use of a mechanical 
actuator with a lesser positional operating range. Without the constraints of a 
larger operating range, actuators with much higher resolutions can be used making 
finer correction possible. In addition, the correction algorillun can implement an 
electronic pixel correction if the mechanical actuator runs out of operating range. 

Many other embodiments can be conceived combining some 
elements of electronic, opticd and mechanical correction. For example, it may be 
beneficial in a system to perform the x and y correction electronically, and then 
the skew correction with a prism or mechanical actuator. 

The invention has been described in detail with particular reference 
to certain preferred embodiments thereof, but it will be understood that variations 
and modifications can be effected within the scope of tiie invention. 



- 16- 
PARTS LIST 



1. 


Lamo-h ous e 




J-uL^UL \J\jV\-\j l_>CJJ.a 


3. 


Cold MiiTor 

X_>'V/XV^ J.TX.XX1VA, 


4 


Tn'i'f^crf^'H'n £>■ Rut* 


5 
%j . 


xiiL/ut vyutiw 


o. 


ocparallXLg X-CuDc 


7 


iVlllIUid 




X5 cdinapiitccr 


Li Q 




10 


Rlnp ■nr\1?i'ri'7PT* piil^p 




T? pf^ iTTi^icyp tnoHiiljitin CT *^p\7'if'p 


iH 12 


Rliip irns^cTP TnoHnlatmcr ripvipp 


1 ^ 


JvCU linage illUU-UlclLillg UCVlLC auLUaLUi 


5 3 It-. 


OlUc UlldgC inuuuxatiiig CICVICC aClUdXOr 


f1 1 5 




n 1 o. 


urrcen image luouuiaxing ucvicc 






1 n 


\^oinuiiiiiig x-cuDC 


1 o 


Partial niirror 


1 Qn 


i ciipiiciy iiuiiui 


ZU. 


Lens 


21. 


Digital sensor 


21a. 


Periphery digital sensor / Mask combinat 


11. 


MasK 


zo . 


rlOJCCtlOTl ICTIS 


24. 


Projection screen 


25. 


Micro-controller 


26. 


Imaging surface 


27. 


Color filters 


28. 


Cylindrical/spherical lenses 


30. 


Input optics 



- 17- 













riauciaX uclcCUOn piouc 




Ola. 






Olt). 


Ullage roi/Uo riuuciai z 






Image oi rlQuCiai i 










oo. 


Early Defocused Image Of Focus Fiducial 




04. 


In Focus Image of Focus Fiducial 




Oj. 


Late Focus Image of Focus Fiducial 




00. 


oainpic JrOCUS JDITOr olgnal 




n(\ 


Fiducial Monitoring and Projection Portion 


m 


1 An 


Image modulating mounting plate 


s 


1 r\i 


Image modulating device 




102. 


Active pixel Area 




103. 


Area inside active pixel area used for image 




104. 


Area inside active pixel area used for fiducial pixels 




110a. 


Fiducial 1 


= ^3? 


110b. 


Fiducial 2 



